1996 

NASA/ASEE SUMMER FACULTY FELLOWSHIP PROGRAM 


MARSHALL SPACE FLIGHT CENTER 
THE UNIVERSITY OF ALABAMA 

VIRTUAL REALITY SIMULATION OF THE INTERNATIONAL SPACE 

WELDING EXPERIMENT 


Prepared By: James A. Phillips, Ph D. 

Academic Rank: Senior Research Fellow 

Institution and Department: California Institute of Technology 

Division of Physics, Math, and Astronomy 


NASA/MSFC: 

Office: 

Division: 

Branch: 

MSFC Colleague: 


Mission Operations Laboratory 
Operations Engineering 
Crew Systems Engineering 

Joseph P. Hale, M S., C.H.F.P. 


XXXII 





VIRTUAL REALITY SIMULATION OF THE INTERNATIONAL SPACE 

WELDING EXPERIMENT 


1. INTRODUCTION 

Virtual Reality (VR) is a set of breakthrough technologies that allow a human being 
to enter and fully experience a 3-dimensional, computer simulated environment. A true 
virtual reality experience meets three criteria: 

1. It involves 3-dimensional computer graphics. 

2. It includes real-time feedback and response to user actions. 

3. It must provide a sense of immersion. 

Good examples of a virtual reality simulator are the flight simulators used by all branches 
of the military to train pilots for combat in high performance jet fighters. The fidelity of 
such simulators is extremely high — but so is the price tag, typically millions of dollars. 

Virtual reality teaching and training methods are manifestly effective, and we have 
therefore implemented a VR trainer for the International Space Welding Experiment. My 
role in the development of the ISWE trainer consisted of the following: 

1. I created texture-mapped models of the ISWE’s rotating sample drum, technology 
block, tool stowage assembly, sliding foot restraint, and control panel. 

2. I developed C code for control panel button selection and rotation of the sample 
drum. 

3. In collaboration with Tim Clark (Antares Virtual Reality Systems) I developed a 
serial interface box for the PC and the SGI Indigo so that external control devices, 
similar to ones actually used on the ISWE, could be used to control virtual objects in 
the ISWE simulation. 

4. In collaboration with Peter Wang (SFFP) and Mark Blasingame (Boeing) I 
established the interference characteristics of the VIM 1000 head-mounted-display 
and tested software filters to correct the problem. 

5. In collaboration with Peter Wang and Mark Blasingame I established software and 
procedures for interfacing the VPL DataGlove and the Polhemus 6DOF position 
sensors to the SGI Indigo serial ports. 

The majority of my ISWE modeling effort was conducted on a PC-based VR 
Workstation, described below. 


2. THE PC VIRTUAL REALITY STATION 

The first point in the 3-point definition of Virtual Reality, above, involves 3D 
computer graphics. The rule of thumb in digital video is that an animation must run at 
least 15 frames/sec to appear smooth to the human eye. so I adopted 15 frames/sec as a 
benchmark for evaluating PC performance. I benchmarked four different PC systems 


XXXII- 1 



using the Sense8 WorldToolKit software to render a virtual reality scene consisting of 
approximately 750 polygons. The results for shaded and shaded+textured polygons are 
tabulated below. Only the Pentium systems gave frame rates for complicated simulations 
that were above 15 frames/s. A comparison of the two 486-based systems shows similar 
frame rates despite the factor of two difference in system RAM. In fact, the 80 MHz 
system with only 8MB of RAM outperformed the 66 MHz system with 16 MB RAM by 
a factor of 1.21, almost exactly the ratio of the clock speeds. The relative frame rates of 
the two Pentium systems also scaled with clock speed, the 120 MHz system being about 
25% faster than the 90 MHz system. (Note, however, that the 120 MHz Pentium had a 4 
MB graphics board while the 90 MHz system had a 2 MB board.) 


TABLE 1 : PC Performance comparisons 


Processor 

Clock 

RAM 

Graphics Accelerator 

Shaded 

frames/s 

Textured 

frames/s 

486DX 

66 MHz 

16 MB 

Cirrus Logic w/1 MB ram 

7.5 

4.0 

486DX 

80 MHz 

8 MB 

Trident 9440CX w/1 MB ram 

9.1 

3.6 

Pentium 

90 MHz 

32 MB 

ATI Mach 64 w/2 MB ram 

16.7 

7.5 

Pentium 

120 MFIz 

32 MB 

ATI Mach 64 w/4 MB ram 

21.0 

9.0 


From Table 1 we see that a 90 MHz Pentium system, or better, will give adequate 3D 
graphics rendering performance. 

The second point in the 3-point definition of Virtual Reality was real-time 
interaction to user input. The participant in a VR simulation must be able to navigate 
through the virtual world, select objects, and move them. I tested three devices for user 
interaction with World! oolKit applications: a mouse, a Logitech Cyberman (6 degree-of- 
ffeedom mouse with limited tactile feedback), and a ThrustMaster joystick. I also tested 
the VPL DataGlove and a Spatial Systems Spaceball (6 degree-of-freedom controller) 
using VPL VR simulation software. For picking and moving objects, the DataGlove was 
by far the best. For navigation the ThrustMaster joystick was best. The mouse was 
unintuitive and difficult to learn as a navigation device, as was the Spaceball. The 
LogiTech Cyberman was awful. I tested two Cybermen and both were poorly 
constructed, overly sensitive, and nearly impossible to control. The simple tactile 
feedback feature (a pulse modulation of the controller stem triggered by hitting virtual 
walls or other objects) was satisfying but did not compensate for the other shortcomings 
of the device. In Table 2 I rate the peripherals on a scale of 1 to 10 (10 is best, 1 is worst) 
in two categories: “Picking” refers to the ease with which objects could be selected or 
grabbed with the device, and “Flying” refers to navigation through the virtual 
environment. The ratings are subjective, and are based on my own experience with the 
devices, and the experience of students aged 5 to 12 years who have tested the PC with a 
VR Human Cadaver application developed at the MSFC virtual reality lab. 
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TABLE 2: EVALUATION OF VR PERIPHERALS 


Device; 

Picking 

Flying 

Microsoft Mouse 

8 

n 

J 

Logitech Cyberman 

5 

1 

VPL DataGlove 

9 

7 

SpaceBall 

6 

6 

ThrustMaster Joystick 

N/A 

9 


Finally, the third point in my definition of Virtual Reality is that the experience must 
be immersive. Immersion means that you forget about all outside stimuli and become a 
thinking, feeling part of the computer’s virtual world. In theory, total immersion would 
include touch, smell, temperature, visual input, and sounds. In practice, it is difficult, 
expensive, and, fortunately, unnecessary to attack all 5 senses to produce a sense of 
immersion. I find that the visual cues provided by a wide-field-of-view head-mounted 
display in combination with 3-dimensional sound effects are sufficient to create a 
powerful immersive effect. The mind fills in the gaps not covered by the HMD and the 
3D sound hardware. 

2.1 3D SOUND 

3D sound technology operates on the principle that all the spatial information about a 
sound source is contained in its spectrum. At its source the complex Fourier spectrum of 
a sound is S(/), where / is the frequency. The acoustic wave propagates to both ears and 
is filtered by reflections off the human body, primarily the head and shoulders, and the 
inner ear. When the sound reaches the inner ear, its complex spectrum is T, (n,/)S(/) in 
the left ear and T R (n,/)S(/) in the right ear; n is the unit direction vector toward the sound 
source and T is the “transfer function.” The product T(n,/)S(/) in the frequency domain 
can be expressed as a convolution in the time domain T(n,/)*S(/), and this is the basis of 
practical 3D sound devices. 

The Alphatron is an expansion card for the PC, sold by Crystal River Engineering, 
that performs the 3D sound convolution. The head-related transfer function, T(n,t), is 
loaded into a digital signal processor on a Tahiti MultiSound card, and up to 16 user- 
defined sounds, S(/), can be spatialized in real time. The cost of the system is $750 retail, 
and I have successfully incorporated 3D sound effects in WorldToolKit applications 
using the Alphatron. 

2.2 HEAD-MOUNTED DISPLAYS 

In 1994 Virtual I/O released the iglasses!, the first high-quality HMD for under 
$1000. The iglasses! feature a 25 deg (H) x 9 deg (V) field of view, with 640 x 480 
active matrix pixels. It weighs only 8 oz. and features a superb ergonomic design. The 
restricted field of view is the main limitation of this device, but for the price ($850 retail) 
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it can’t be beat for low-cost educational applications. A far better HMD is the VR4 by 
Virtual Research, Inc. It features a 48 deg (H) x 30 deg (V) field of view with resolution 
comparable to that of the iglasses!. The wide field-of-view is critical for total immersion 
simulations, and the VR4 would be the helmet of choice except for its price tag, $7000, 
which makes it impractical for most classroom situations. 

Finally, I note that WorldToolKit is the software of choice for PC-based VR 
applications because of its support for nearly all the VR peripherals on the market today. 
Sense8 rapidly introduced a driver for the iglasses! very soon after the product was 
released, and third party software vendors, like Crystal River Engineering, are working to 
make their library calls compatible with WorldToolKit conventions. 

3. SUMMARY 

During the 1996 Summer Faculty Fellowship Program I collaborated with other 
members of the CAVE lab to implement a VR simulation of the International Space 
Welding Experiment (ISWE) on a PC-based VR Workstation and on a Silicon Graphics 
Indigo. I created texture-mapped models of the ISWE’s rotating sample drum, 
technology block, tool stowage assembly, sliding foot restraint, and control panel. I 
developed C code for control panel button selection and rotation of the sample drum. I 
also developed a serial interface box for the PC so that external control devices, similar to 
ones actually used on the ISWE, could be used to control virtual objects in the ISWE 
simulation. 
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